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Objectives: The objective of this study was to create a new measure for clinical information technology (IT) adoption as a 
proxy variable of clinical IT use. Methods: Healthcare Information and Management Systems Society (HIMSS) data for 2004 
were used. The 18 clinical IT applications were analyzed across 3,637 acute care hospitals in the United States. After factor 
analysis was conducted, the clinical IT adoption score was created and evaluated. Results: Basic clinical IT systems, such as 
laboratory, order communication/results, pharmacy, radiology, and surgery information systems had different adoption pat- 
terns from advanced IT systems, such as cardiology, radio picture archiving, and communication, as well as computerized 
practitioner order-entry. This clinical IT score varied across hospital characteristics. Conclusions: Different IT applications 
have different adoption patterns. In creating a measure of IT use among various IT components in hospitals, the characteris- 
tics of each type of system should be reflected. Aggregated IT adoption should be used to explain technology acquisition and 
utilization in hospitals. 
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I. Introduction 

Studies of clinical information technology (IT) have in- 
creased considerably in recent years with the growing rec- 
ognition of the importance of clinical IT in the context of 
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healthcare quality and costs [1-15]. Previous studies have 
found that clinical IT could significantly increase quality and 
productivity, and decrease costs [1-14], although some stud- 
ies have found a weak impact [9,16]. Many studies have ad- 
opted different approaches to measure IT adoption because 
healthcare facilities use many diverse IT systems. However, 
few studies and even fewer discussions have addressed how 
IT adoption should be measured in various clinical settings. 
It is important to measure IT adoption correctly because we 
must clearly understand the degree of IT adoption to fully 
understand the level of IT dispersion in healthcare facili- 
ties. In previous studies, IT adoption has been categorized, 
broadly, using two methods. One is to measure IT adoption 
by whether or not hospitals adopt a specific IT system. Sev- 
eral researchers have used this method to identify adoption 
of IT systems, such as Computerized Physician Order Entry 
(CPOE) systems and Electronic Medical Record (EMR) 
systems [1,4,5,7,9]. However, such studies cannot broadly 
explain technology acquisition and utilization because they 
ignore the other clinical IT systems in use. These studies may 
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fit well or be appropriate in studies when researchers focus 
on the effect of a specific IT system. 

The other method is to measure IT use with an aggregated 
score by assigning equal weight to each IT application [2,6] . 
Although this method better estimates the effect of using ag- 
gregated IT systems, it still has limitations in that the assign- 
ment of equal weight to IT systems can lead to inaccurate re- 
sults. For example, adopting a basic system (e.g., a radiology 
information system) would be deemed equivalent to adopt- 
ing an advanced system (e.g., a CPOE). Healthcare organiza- 
tions may differ in their patterns of introducing various IT 
systems. Healthcare organizations with less experience in 
using clinical IT systems would likely invest in less expensive 
IT systems, and those with more experience would likely 
adopt more sophisticated and expensive systems. Obviously, 
giving both types of IT system equal weight could result in 
large measurement errors by underestimating the weight of 
hospitals with advanced clinical IT, such as CPOE or EMR. 

Although there is some debate on measuring the use of 
clinical IT by counting with equal weight as mentioned 
above, a measure more sensitive to the type of IT could pro- 
vide an important index for the overall level of IT adoption 
in healthcare organizations. 

We may choose a more advanced approach from the second 
one above when we have to measure IT adoption by showing 
the degree of overall IT adoption. Many IT applications are 
adopted in healthcare organizations and are closely related 
with multi-products. For example, Picture Archiving Com- 
munication Systems (PACSs) are related with X-ray, imaging 
diagnosis, or laboratory resources. Therefore, to estimate the 
potential impact of clinical IT systems on hospital output, it 
is necessary to measure IT systems aggregately by reflecting 
different weights for diverse IT systems. Few studies have 
measured clinical IT systems this way. With the current na- 
tional healthcare reform in the United States, it is imperative 
to measure the degree of clinical IT application aggregately 
in healthcare organizations. 

Lacking a clear and accurate measurement of clinical IT 
may have precluded answering vital theoretical and policy 
questions related to clinical IT. Therefore, developing the ag- 
gregated clinical IT adoption measure is necessary. Thus, this 
paper focused on developing an aggregated score of clinical 
IT adoption (CITA) by allocating different weights to vari- 
ous clinical IT systems. 

II. Methods 

1. Data and Study Variables 

Healthcare Information and Management Systems Soci- 
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ety (HIMSS) data was used for the available year of 2004. 
HIMSS data is the most comprehensive report on hospital 
adoption of IT applications in the United States. Its sample 
came from the American Hospital Association (AHA) sur- 
vey and includes nearly all general hospitals with more than 
100 beds, as well as some smaller hospitals. This data has 
been used in many studies [2-9,15]. The unit of observation 
is acute care hospitals which totaled 3,637 in 2004. Fifty-six 
IT applications are identified, which include IT systems of 
business offices, financial management, and human resource 
systems. However, this paper includes only the 18 clinical IT 
systems based on the HIMSS definition [16] because clinical 
IT systems are oriented toward quality of care, which is the 
most important goal of hospitals. Each clinical IT system is 
considered to be adopted if the adoption status is automated, 
contracted, or replaced. The clinical IT applications included 
are listed in Table 1 . In addition, this study defines "basic IT 
systems" as computerized systems that can help medical cli- 
nicians to store and to pull out clinical data from computer 
systems and "advanced IT systems" as computerized systems 
that can allow the exchange of clinical information across 
physicians or organizations. 

2. Statistical Analysis 

To aggregate clinical ITs, factor analysis (FA) was applied. 
FA clusters variables into homogeneous sets and can handle 

Table 1. List of clinical IT 

Cardiology Picture Archiving and Communication System (PACS) 

Cardiology Information System 

Clinical Data Repository 

Clinical Documentation 

Computerized Patient Record 

Computerized Physician Order-Entry System 

Clinical Decision Support 

Emergency 

Intensive Care 

Laboratory Information System 
Nursing Documentation 
Obstetrical Systems 
Order Communication/Results 
Pharmacy Information System 
Point of Care 

Radiology Information System 

Radiology PACS 

Surgery Information System 
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many variables without the degree-of-freedom problems 
faced in regression analysis [17]. FA is a statistical tool de- 
scribing variability among observed variables into fewer un- 
observed variables and the information gained can be used 
to reduce the dimensions of variables in a dataset. FA has 
been usually applied in psychology and social science [18] . 

The most commonly-used FA is principle component 
analysis (PCA). In PCA, the extracted components are not 
correlated to one another. The first extracted component in 
PCA is a linear combination of the original variables, and it 
explains the maximum variance among the variables. The 
second principle component is extracted from a residual 
matrix generated after removal of the first principle compo- 
nents. This extraction process is repeated until the variance- 
covariance matrix is turned into random error. In this way, 
the first extracted component explains the maximum vari- 
ance, and the second one explains the least variance. This 
PCA approach assumes that the items included can be per- 
fectly accounted for by the extracted components [18]. The 
observed variables are modeled as linear combinations of the 
factors as follows: 

y = Aj/i + A 2 / 2 + + Xjfj + £ , i = 1, 2, 3,. . ., I 
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where y is the adoption status of clinical IT (0 or 1), i is the 
number of factors, and /is the vector latent common trend 
or factor loading shared by a set of response variables; A is 
the factor loading representing the correlations of each of 
the items with the factor, and it determines the form of the 
linear combinations of the common pattern. By compar- 
ing factor loadings, we can infer which common pattern is 
meaningful to a certain response variable, as well as which 
group of response variables shows the same common pattern 
[19]. For the analysis, this study used Stata ver. 10.1 (Stata- 
Corp., College Station, TX, USA). 

III. Results 

1. General Characteristics of Study Subjects 

Table 2 shows the percentages and standard deviations of 
hospitals adopting each clinical IT system. The basic systems, 
including laboratory and pharmacy information systems, 
had adoption rates over 90% in 2004, while the adoption rate 
of advanced clinical IT systems, including CPOE and PACS, 
was low. Basic IT systems just collect clinical data from pa- 
tients, but advanced IT systems can exchange this informa- 
tion across physicians or organizations. 



Table 2. Descriptive statistics of clinical IT adoption rate 



Variable 


No. of hospitals adopted IT system 


Mean adoption rate (°/o) 


SD 


Cardiology Information System 


971 


26.7 


0.442 


Cardiology PACS 


356 


9.8 


0.297 


Clinical Data Repository 


2,444 


67.2 


0.469 


Clinical Decision Support 


2,240 


61.6 


0.486 


Clinical Documentation 


2,524 


69.4 


0.461 


Computerized Patient Record 


2,073 


57.0 


0.495 


CPOE 


807 


22.2 


0.416 


Emergency 


1,920 


52.8 


0.499 


Intensive Care 


1,149 


31.6 


0.464 


Laboratory Information System 


3,477 


95.6 


0.203 


Nursing Documentation 


2,440 


67.1 


0.455 


Obstetrical Systems 


589 


16.2 


0.368 


Order Communication/Results 


3,317 


91.2 


0.283 


Pharmacy Information System 


3,502 


96.3 


0.189 


Point of Care 


1,586 


43.6 


0.496 


Radiology Information System 


3,277 


90.1 


0.299 


Radiology PACS 


1,589 


43.7 


0.496 


Surgery Information System 


2,888 


79.4 


0.407 


Total 


3,637 







PACS: Picture Archiving and Communication System, CPOE: Computerized Physician Order-Entry System, SD: standard deviation. 
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We also checked the correlation matrix for 18 clinical IT 
systems (not reported). The correlation varies from 0.05 to 
0.54, but most are around 0.2, indicating that FA can be ap- 
plied [18]. 

2. Information Technology System with Similarity 

Table 3 shows the factor loading of the same items on the 
four rotated principle components after varimax rotation. 
Varimax rotation was used to simplify the columns of the 
unrotated factor loading matrix. Using varimax rotation al- 
lows for the variances of the loadings within the factors and 
differences between the high and low loadings to be maxi- 
mized to 20. The factor loading is the correlation between 
an IT system and a factor. Table 3 shows only factor loadings 
greater than 0.4. 

While analysis shows four different groups by factors, it 
cannot distinguish basic IT systems from advanced ones. 
Therefore, IT systems were grouped into four levels based on 
the adoption rate in Table 2. For example, five applications 
under factor 2 in Table 3 were assigned to basic or first level 
because their adoption rate was the highest among all other 
groups, around 90%. The other three groups of IT applica- 
tions were assigned similarly. Therefore, the first level (basic 
clinical ITs) included Laboratory Information Systems (LISs), 
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Order Communication/Results (OC/R), Pharmacy Informa- 
tion Systems (PISs), Radiology Information Systems (RISs), 
and Surgery Information Systems (SISs). The second level 
included Clinical Data Repositories (CDRs), Clinical Deci- 
sion Support (CDS), Clinical Documentation (CD), Com- 
puterized Patient Record (CPRs), Nursing Documentation, 
and Point of Care (POC). The third level included cardiology 
information systems, as well as emergency, intensive care, 
and obstetrical systems. The fourth level (most advanced 
clinical ITs) included cardiology PACSs, CPOE systems, and 
radiology PACSs. 

3. Patterns of Clinical IT Adoptions 

In Table 4, we can consider that the IT applications in each 
level are adopted consecutively. For example, if a hospital 
adopts an LIS, it is more likely to adopt an RIS rather than 
CPOE or PACS. Among 18 clinical IT systems, we gener- 
ated four groups based on the adoption rate and results of 
FA. Each component in the four groups has similar charac- 
teristics which the hospitals go through in the process of IT 
adoption. 

4. Evaluating Validity of the CITA Score 

To calculate the CITA, different weights were assigned to 



Table 3. Factor analysis results 



Variable 


Factor 1 


Factor 2 


Factor 3 


Factor 4 


Uniqueness 


Cardiology Information System 






0.776 




0.379 


Cardiology PACS 








0.717 


0.478 


Clinical Data Repository 


0.684 








0.471 


Clinical Decision Support 


0.457 








0.727 


Clinical Documentation 


0.676 








0.475 


Computerized Patient Record 


0.523 








0.610 


CPOE 








0.438 


0.680 


Emergency 






0.541 




0.599 


Intensive Care 






0.423 




0.446 


Laboratory Information System 




0.738 






0.429 


Nursing Documentation 


0.481 








0.628 


Obstetrical Systems 






0.604 




0.599 


Order Communication/Results 




0.727 






0.411 


Pharmacy Information System 




0.639 






0.584 


Point of Care 


0.743 








0.391 


Radiology Information System 




0.639 






0.525 


Radiology PACS 








0.732 


0.429 


Surgery Information System 




0.545 






0.542 



PACS: Picture Archiving and Communication System, CPOE: Computerized Physician Order- Entry System. 
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each level. For example, weight "1" was assigned to the first 
level, 2 to the second level, 3 to the third level, and 4 to the 
fourth level. ITs in the lower level have lower weight because 
they are basic and less effective or of lesser value compared 
to ITs in the higher level. Then, the weighted clinical ITs 
were aggregated to get the CITA score for each hospital. For 
example, a hospital which adopted three ITs in level 1, four 
in level 2, and two in level 3 had a CITA score of 17 (= 3 x 1 
+ 4x2 + 2x3). CITA scores ranged from 0 to 41 and aver- 
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aged 18.76 (standard deviation, 8.38). 

Moreover, this study investigated CITA scores across hos- 
pital characteristics, such as teaching status, number of beds, 
and ownership, as shown in Table 5. Teaching status is classi- 
fied as teaching or non-teaching. Number of beds is defined 
as licensed bed. Ownership is classified as for-profit, not-for- 
profit, and government. Teaching hospitals had CITA scores 
that were 5.62 points higher, which was statistically sig- 
nificant. Not-for-profit hospitals had 2 points higher CITA 



Table 4. Adoption stage of clinical IT 



Adoption stage 


Name of clinical IT 


Adoption rate (%>) 


First level 


Laboratory Information System 


95.6 




Order Communication/Results 


91.2 




Pharmacy Information System 


96.3 




Radiology Information System 


90.1 




Surgery Information System 


79.4 


Second level 


Clinical Data Repository 


67.2 




Clinical Decision Support 


61.6 




Clinical Documentation 


69.4 




Computerized Patient Record 


57.0 




Nursing Documentation 


67.1 




Point of Care 


43.6 


Third level 


Cardiology Information System 


26.7 




Emergency 


52.8 




Intensive Care 


31.6 




Obstetrical Systems 


16.2 


Fourth level 


Cardiology Picture Archiving and Communication System 


9.8 




Computerized Physician Order-Entry System 


22.2 




Radiology Picture Archiving and Communication System 


43.7 



Table 5. Clinical IT adoption score across hospital characteristics 





Characteristic 


Score (SD) 


f or F-tesf 


p-value 


Teaching status 


Teaching 


23.86 (7.34) 


-18.71 


<0.01 




Non-teaching 


18.24 (8.31) 






Ownership 


For-profit 


16.93 (6.33) 


77.59 


<0.01 




Not-for-profit 


20.06 (8.14) 








Government 


17.68 (8.67) 






Bed-size 


<83 (<25%) 


14.33 (9.13) 


176.96 


<0.01 




83-167 (25%-50%) 


18.11 (7.45) 








168-306 (51%-75%) 


19.98 (7.19) 








>306 (>75%) 


22.56 (7.41) 







SD: standard deviation. 

a f-test for teaching states and chi-square or analysis of variance for ownership and bed-size. 
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scores than for-profit and government hospitals. Lastly, hos- 
pitals with the most beds had the highest CITA scores. 

IV. Discussion 

Measuring aggregated clinical IT is important in order to 
analyze the effect of IT on hospital outcomes. Because hos- 
pitals produce multiple products using multiple IT systems, 
it is necessary to measure clinical IT systems accurately and 
aggregately. This study used HIMSS data to create a CITA 
score after using FA to measure the degree of clinical IT use. 
This study found that most hospitals were adopting a basic 
system, such as a laboratory and pharmacy information 
system, and a few were installing CPOE and PACS, or an 
advanced one. This study result indirectly suggests an im- 
portant implication for future studies. Evaluating the level 
of clinical IT use of healthcare organizations may be better 
evaluated by determining whether or not they had an ad- 
vanced clinical IT system, such as COPE or PACS. 

The study results also show that some clinical IT systems 
had similar characteristics. LIS, OC/R, PIS, RIS, and SIS 
could be grouped into one type of system with common 
characteristics and CPOE and PACS in another. This study 
got the result of four groups, although it could be less than or 
more than four groups. It is necessary to study further how 
these four groups differ from each other and how they affect 
health outcome or organizational performance differently 

An interesting finding is that IT systems in each level are 
adopted consecutively. This finding is exactly in line with 
several theoretical arguments [20,21]. Theoretical argument 
says that there are early adopters and laggards to the ad- 
vanced technologies. Depending on hospital characteristics, 
some would adopt CPOE or PACS early, and others would 
not. 

This study also found that the level of clinical IT adoption 
differs in degree by hospital characteristics. Teaching status, 
ownership such as profit versus non-profit status, and bed- 
size of hospitals were closely related to clinical IT adoption 
status measured with a proxy variable of CITA score. Teach- 
ing hospitals, not-for-profit hospitals, and hospitals with 
large bed-size had higher clinical IT adoption levels, which 
is consistent with the findings many other studies [2-4,6,8,9]. 

The study is limited in generalizability. First, it is a cross 
sectional study. Therefore, we need to be cautious when ap- 
plying this CITA score to a different year. Second, only acute 
care hospitals were sampled. Thus, the CITA score may vary 
if other hospitals (i.e., long-term care and critical access 
hospitals) were included. Third, an arbitrary weight was at- 
tributed in each category. Therefore, the CITA score will be 
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different with different weight. However, for comparison, 
we need ordinal scores which rank hospitals by score. Even 
though we applied various weights, similar results were ob- 
tained in score order. 

Overall, this paper suggests that different IT systems have 
different adoption patterns. Therefore, aggregated IT systems 
should be used to explain technology acquisition and utiliza- 
tion in hospitals. 
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